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Abstract 


Until the 1980s, the system for assessing the performance of organizations with specific structures has been based on economic 
and financial indexes. The previous methods that were frequently used for performance assessment were mainly focused on 
the economic-financial aspects of the organization. However, at present, due to vast human needs, sensitive cognitive, 
fundamental parameters in social organizations that are based on realities, are very effective, and meet scientific criteria have 
come into vogue. These parameters rely on experience, observation, experiment, hypothesis, and theory. Balanced Scorecard 
(BSC) seeks to make a balance between financial and economic objectives as outcomes of past performance (past-oriented 
indexes) and three indexes of customer processes, learning and growth, and development of human and social forces (future- 
oriented). 

Data Envelopment Analysis (DEA) is a non-parametric method for measuring the outputs or efficiency of homogeneous units 
with different inputs and outputs. However, in cases where there are numerous inputs and outputs with some similarities, their 
efficiency can be measured by two-level DEA, i.e., classifying them and using common weights. 

In primitive social institutions, the inputs of social systems are mainly limited and clear. However, in modern, complex, 
standardized systems, the input is both expanded and diversified. Therefore, in this paper, we have tried to use BSC as an 
instrument for designing performance assessment indexes and two-level DEA as an instrument for measurement. 
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1 | Introduction 


TON In 1978, Charnes et al. [1] established a method of efficiency or output measurement, which is 
Computational considered to be one of the acceptable, popular methods that provide managers significant assistance 
Algorithms and in a better understanding of the area they are managing. In the last two decades, numerous papers 


Numerical Dimensions. | and reports have been published in internationally reputable journals. It indicates that the method has 
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input and output indexes are placed in categories, and their weight value is calculated within the DEA 
framework. 


In the real world, many problems have such properties. For instance, the assessment of R & D projects, 
the calculation of the efficiency of universities, performance assessment for productive structures, and, 
most importantly, the calculation of social organizations in cultural and evolutionary areas can be cited 
as examples of such issues. 


In addition to the simplicity of calculations, this approach uses average weight value and enjoys more 
discrimination power compared with single-level approaches. In this study, we intend to concentrate on 
combining this approach with the Balanced Scorecard (BSC) technique. BSCs explore the extent of 
fulfillment of organizational goals from different aspects. In the BSCs technique, the effectiveness of 
organizational strategies is measured through the identification of indexes for the achievement of goals. 
The BSCs technique divides its indexes under four categories: financial-economic perspective, customer 
processes, and learning, growth, and development of social-human forces. They tried to establish a 
balance between financial objectives as a result of past performance (a priori indexes) and three other 
indexes (a posteriori indexes). In fact, it tries to scrutinize an absolute relation between the social 
planning system for human-oriented organizations that are based on the life opportunities and lifestyles 
of the people, the goals that planners consider for such systems and their expenditures. 


The combinational method of BSCs and DEA that forms a strong instrument has been created recently. 
The strengths of BSC methods in the selection of indexes, on the one hand, and the capability of DEA 
in the exact measurement of efficiency, on the other hand, have caused the combinational method to 
emerge as an effective tool for measuring organizational performance. Dean of Industrial College of 
Technix University, used the combinational BSE-DEA method for the first time for the assessment of 
R&D projects. In his two papers, he was trying to find a way to measure organizational efficiency after 
using balanced measurement. He used DEA as the core model [2], [3]. Furthermore, in another paper, 
Benker [4] used the BSC as its core model and the DEA algorithm as an auxiliary method. 


On the one hand, the presence of numerous social indexes in four areas of BSC inputs and outputs has 
created some problems for calculation and measurement. On the other hand, using two-level DEA and 
placing similar indexes in categories of BSCs has made calculation practically easier. 


The present research aims to develop a suitable socio-cultural model for measuring organizational 
efficiency and productivity and identifying organizational weaknesses and strengths. Furthermore, it can 
suggest mechanisms for consolidating the strengths and minimizing the weaknesses of the organization 
in the future. 


In the Section 2, we review the BSC method. The Section 3 discusses DEA in detail. Two systems of 
performance assessment, i.e., BSCs and two-level DEA, and the assessment algorithm of the 
combinational method are discussed in Section 4. Section 5 is devoted to the application of the model, 


and in Section 6, some conclusions ate drawn. 
2 | Balanced Score Card 


In the 1990s, the BSC model was used first as a new method of performance assessment and later as a 
tool for the realization of strategy, or better to say, a system for strategy by Robert Coplan, the famous 
professor of Harvard University and David Norton, the distinguished management advisor in America 


and was embraced by scholars of management and organization managers. 


Research on organizational management reveals that the traditional systems of calculating organization 


assets merely accounted for tangible assets such as equipment, land, existing materials, etc., and were 
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not capable of calculating the human assets!, including personnel satisfaction and flexibility of users of 


mass culture, interactions, socialism, and the like. Therefore, systems that are capable of measuring and 
calculating such assets are seriously needed. In fact, performance measurement systems are considered the 
strongest and most needed management systems in managing modern human and social organizations. 
Certainly, without such a system, strategic decision-making, measuring the extent of strategy 
implementation, and evaluating performance and organizational processes in modern societies seem to be 
very difficult. 


Insufficiency of financial criteria for performance measurement made organization planners evaluate their 
other activities such as human interactions, innovative processes, sociability, culturalization, and training 
users, and add other criteria to financial ones for measuring their performance.” Although the combination 
of these activities is the cornerstone of success for any organization, few people are able to select, through 
effective management, the appropriate criteria for such activities in a way that they lead the organization 
towards their perspective and mission” [5], [6]; a perspective that is considered as the core of BSC for 
translating missions and strategies into goals and criteria. It shall be emphasized that BSC is not simply a 
control system, and its criteria are not merely used for describing past performance. Rather, such criteria 
will be instrumental in determining and transferring organizational strategy so that they are designed for 
converging and coordinating innovations at individual, departmental, and organizational levels so that 
obtaining common goals is made possible. Of course, selecting an appropriate instrument for performance 
measurement is not sufficient in itself, and progressive organizations use performance measurement results 
to improve and successfully implement their strategies. 


This catd is a conceptual framework designed for translating the strategic goals of an organization into a 
collection of performance indexes, which are usually selected from among four aspects of finance, 
customers, internal processes, and learning, growth, and development for measuring social institutions and 
otganization and can be presented as the model bellow [3], [5]. 


In fact, the organization can use this card to keep informed of its economic and social performance, 
outputs of internal processes, and efforts for improving the motivation and training of its personnel and 
its learning system. Therefore, by utilizing BSCs in organizations, we can move towards implementing 
otganizational strategies by understanding the existing conditions and identifying appropriate indexes for 
evaluation.[2], [5], [6], [7]. 

We can summarize the four dimensions of BSCs by answering the following questions: 


Financial-economic measures 


What are the expectations and demands of shareholders from a social organization? What goals, measures, 
and executive plans are required for the fulfillment of beneficiaries expectations? 


Customer perspectives (the social clientele) 


What are the expectations of the people from a social system? What goals, measures, and executive plans 
are required for the fulfillment of public expectations? 


Internal process perspective 


What activities shall be carried out to fulfill public and government expectations and demands? What key 


processes are required for such activities? 


! Nowadays it is sometimes called social capital 


Learning and growth perspective 


Since the needs of the people, governing bodies, and beneficiaries are identified. The processes required 
to fulfill such needs are determined; the next question is, who is responsible for carrying out these 
activities and processes? What human resources, information technology, and organizational 


infrastructures shall exist to ensure effective, efficient work? 


Put briefly, the process of compilation and implementation of the balanced evaluation method and its 
application in society-centered organizations helps managers to synchronize their strategies at different 
levels of the organization and ensure that all members of the organization are well-informed of the long- 
term goals of their unit and the strategies that the organization has adopted for achieving such goals. 
This model is a technique for translating strategy into practice and making goals, missions, and strategies 
operational. It is focused on reviewing the future perspective of the organization. 


3 | Data Envelopment Analysis 


In 1957, Farrell [8] started to measure the efficiency of production units for the first time. In this model, 
efficiency was taken as equal to the proportion of inputs to outputs. The inherent problem with this 
model was the assumption that inputs and outputs are of the same importance. However, contrary to 
many production units, in public-centered organizations, inputs and outputs do not have the same 
degree of importance. Using outputs and inputs of DMUs, he processed the production function on a 
collection of inputs and outputs in a way that the outcome was a linear segmental function. 


Suppose that there exists n DMUs in the form of {DMU}: j=1.,....n}, each using m different inputs for 
producing s outputs, with yrj and xij as rth output of r=(1,..., s), respectively and ith input of i= (1,..., 
m) of the j th DMU j=(1,..., n). 


If we suppose that u=(u1,u2,..., us) and v= (v1,v2,..., vm) are vectors of weights for outputs and inputs, 
respectively, the efficiency of DMUp as a multiple and input will be as follows: 


r=1 
S m 
S.t. X Uys- X V <0, j=1,....n, 
r=1 i=l (1) 
m 
X Vixp=L 
i=1 
Vize, i=1,....n, 
U, 2e, T= Taes 


The multiple dual Eq. (1) is called the envelopment form of the CCR model with the input nature and 
@ is called the relative efficiency of DMUs. If @"is the optimum amount of the target function, then 
O0<@ <1 [6]. 


min 


with input nature 


0, 
n 
CCR envelopment form, 
st OXp_ J AXj > 0, p 
j=1 
i (2) 
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The amount of @°indicates relative efficiency, and each DMU that is not located on the borderline is 
inefficient. The aim of the CCR input model is to reduce the maximum amount of inputs with the 


proportion of 0° in a way that at least the same output can be produced. 


Generally, in models that are input in nature, with the reduction of DMUP input, if it is inefficient, we lead 


it towards the border to make it efficient. The amount of input decrease is Ox» which is an amount of 


input that could at least produce Yp (16 )x is an amount of wasted input and (1_6") is called the 


amount of inefficiency [2], [9]. 


4 | The Combinational, Two-Level Model of DEA and BSC and 
Modeling 


We know that one of the main reasons for the failure of human-centered organizations is the improper 
application of organizational strategy. To prevent such failure, the organizations shall be able to measure 
the extent of their success in the framework of organization strategy or, to put it more clearly, calculate its 
effectiveness. It means that they shall see whether it is in accordance with their strategy or not. Calculating 
the efficiency with the help of DEA has always been faced with a fundamental problem, i.e., the managers 
and ruling governments who try to influence the compilation of indexes to draw a rosy picture of their 
performance. This method, despite its valuable capabilities, never makes any suggestion on the compilation 


and identification of indexes. 


However, one of the advantages of BSCs concerns index compilation. In other words, the socio-cultural 
concepts that are usually very general and lack any measurement and evaluation model are turned into 
quantitative indexes. After careful measurement and indexation of requirements, the ways to remove these 
needs and obtain the goals can be presented through qualitative analysis of lifestyles and changes in the 
lives of the users, the people. Therefore, using BSCs for the compilation of indexes that are formed in 


proportion to organization strategies can enhance our capabilities if used in combination with DEA. 


BSCs create the strategic maps in four perspectives: 1) people-centeredness, 2) internal processes (how 
institutions fulfill needs), 3) learning and innovation, and 4) growth, development, and evolution. This map 
then helps to prepare indexes in each perspective, which follow the cause-and-effect relationship that exists 
among sub-strategies in the strategic map. One of the interesting points in the BSC method is that it 
considered all of these indexes together, although an increase in one index may lead to a temporary decrease 
in another. 


Fig. 1 shows that the indexes in each domain can be considered within the framework of input or output 


indexes in that domain. 


Considering all inputs and outputs in a DMU has its problems, chief among them are the huge number of 
input and output indexes. Furthermore, since all domains do not have equal value, the calculated 
efficiencies may look unreal. Fig. 2 shows the single-level evaluation model. 


Financial Perspective 


Outputs 


X!o1 


Outputs 
1 
Xo 


Fig. 1. Four domains of balanced scorecards, with input and output indexes. 


Xij Vij 
DEA fey 


E m 


Xmj Ysj 


Fig. 2. Single-level DEA evaluation model. 


Now, if we can classify the input and output indexes into four categories, which are in the four domains 
of BSCs, we can easily account for the weight of each domain. As shown in Fig. 3, we consider a DMU 
with four inputs and four outputs, which have the same order as the four domains of BSCs (learning, 
innovation, growth and development, internal processes, people, and financial-economic domain). 
These four domains are located on the same level, and the indexes for each will be placed on the second 
level. 


Yij 
Inputs of ne Outputs of 
financial domain 4 ai 
: domains 
Ysi 
Yij 
Inputs of cleint Yj Outputs of 
domain JOSIE 
` cultural 
` domains 
Ysi 
Inputs of internal Yij 


processes Yə; Outputs of 


internal 
processes 


Ysi 


Yij 
Inputs of Learning v Outputs of 
and Growth a learning, 
growth and 
Y; development 


Fig. 3. The synthetic model with four categories of inputs and outputs. 
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If we consider k(k=1...4) as the inputs’ counter and t(t=1...4) as the outputs’ counter, and 


u=(u,,U2,u,,u,) and v=(v,,v,,V,,V,) ate weight vectors for inputs and outputs (input and output 


domains at level 1), then the efficiency of DMUp in the multiple form and input nature will be as follows: 


4 
max E = ) uy, 
tp 


t=1 
4 
s.t. X VKXĘKP = 1, 
k=1 (3) 
4 4 
ee <0, jaa 
t=1 k= 
Vk > E, k = 1, 4, 
uy = &, t= 14 


Quantities xyand y, are cumulative input and output, respectively, and if AK is the counter for indexes 
of four input categories (input indexes at the second level) and Bt is the counter for output indexes for 


four categories (output indexes at level 2) Xy and Vy will be defined as follows: 


Xj = J Vik Xikj J Vik =1, 


icAk icAk 
yer ) Urt Vet ) ty =. 
reBt reBt 


Now, by placing the above relation in Eg. (4), we have 


4 
max E = b? U; 2 Urt Yrtp 
t=1 reBt 
4 
s.t XY a X vexe = 1 
k=1 icAk 

4— 4 

Yu, UY divx > Vin Xirg <0, j=1,...n, (4) 

t=1 reBt k=1 keAk 
X ve =, k=1.4, 
icAk 
> TE T aini 
reBt 
Vk 2E, k= 1, 4 
Uy, E, t=1,...4 


The above programming model is considered a non-linear model that will be converted to a linear model 


with the following assumptions: 


Vet Vik = Vix, & Upe Uy = Uy. 


4 
max E = ` > 4 Yrtp, 


t=1 reBt (5) 


4 
s.t. X SY) Pior =1, 


k=1 i€Ak 


t=1 reBt k=1 keAk 
Fix = ve k=1 4, 
icAk 
Y fie = t=1...4, 
reBt z 
U2 0, Vik = 0. 


Regarding the number of variables, the above two-level model is not different from the single-level 
model, and in both cases, we will have m+s variables. The above model will be exactly the same as the 


enveloping CCR model, except for X. ¥,, =V, and >) a, =U, constraints. Of course, variables V,, 
ie Ak reBt 


and û,can be equal to zero and do not need to be positive. No doubt, due to the higher number of 


constraints in the bi-level model, the efficiency achieved is higher than in the uni-level model. 
Now, if we want to have the dual model for the above, we use model Form (2). 


min 60, 


s.t. ACS VX) tS, =O) Vy Xep? k=1...4, 


ieAK ieAK 
A(> U S =2, U t=1...4, 
2 J 92 rt Yaj) + = 2 AY p? (6) 
$ v =l, k=1...4, 
ieAk 
$ u, =1, t=1...4, 


A220, S20, S20. 


The terms A,«u,and A #v are non-linear and will be written as linear ones by the following 


conversions: 


j * Vik = Oi, & À *Vik = Qi. 
j j 


min 
s.t. S > Qi X ikj + S= =0 vv Vik Xikp, k=1...4, 
j=l icAk icAk 
È > BY rtj +S ~ => Tay cig? t= 1...4, 
j=1 reBt reBt (7) 
a =A, k=1.4 j=l..o, 
icAk ; : 
Dba =À; t=1.4 j=1..n, 


ayei p0 Seo S20, 


5 | Implementing a Two-Level Combinational Model 


In the previous parts, the steps that shall be considered in a synthetic system of scored cards and two- 
level DEA were described. To implement the model and extract the results, the data related to six 
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branches of a commercial bank were collected in accordance with the indexes extracted from BSCs, and 


the final results were extracted and analyzed using LINGO software. 


Fig. 4 shows the indexes for four domains of score cards. 


Margin of social profit 


Contractual costs to 
future revenues Ečonomic 
al- Investment 
i financial (economic) vield 
Rate of outstanding ————> Joma 
debts Growth rate for assets 
of societv 
Public satisfaction 
7 Human — C Presenting high quality 
Competitive domains social services 
pricing with other > 
communities Attraction rate for 
sociability 
. . Domain Presenting electrical 
Speeding up services of services 
. . internal ing advanced 
Online services process Presenting advanc 
m social services 
(Social welfare) 
Motivational and 


innovative costs 
Enhancing people`s 


Enhancing expertise and = ——> skills 


efficiency of people 


Fig. 4. Indexes of score cards in four different domains. 
Table 1 and Table 2 show the information for input and output indexes. 


Table 1. Information for indexes. 


3 ! 8 5 E 2 
2 E; 3 ë 7 & 5, Bg OB 
g Of Q 0 & O o 2 3 
S S S 2 >e n DO Oo 
TS a = v 2 oS o & E 
[a< t5] n jam Far =e) Seen =- m ~ 
¢ 2 a Ò D Ge S S p SES vm S 
68 an S © v A a = e AV (3) 
23 pe ¢ 5 g2 #82 Sf £ 
5E €S8 g E 3 S= APE o% = 
g. T e = . = v v 
Eo gsp = 4 g 63 EVE gF g 
8 ò j (3) 5 WO o's O S 0 
in BON A = R= On ORO fH = 


22.91% 3.19% 3.25% 1.48% 4.81% 17.42% 15.7% 2.68% 52.84% DMU1 
25.8% 3.61% 3.21% 2.62% 7.16% 12.98% 18.9% 9.5% 42.77%  DMU2 
29% 3.34% 3.41% 8% 7% 47.59% 34% 15% 60% DMU3 
34.50% 3.41% 3.12% 2.7% 14% 18.9% 33.5% 8.5% 60.2% DMU4 
21.8% 3.93% 3.43% 3% 1.23% 20.13% 30.4% 7.3% 57.9% DMU5 
13% 3.5% 3.74% 4% 1.02% 10.28% 12% 14% 96% DMU6 


Table 2. Information for indexes. 


Dn N 

Da 5 = 
R=) 5 pa E 3 A go] 2 E 5 
Top P v 9 5 o © g z Ù (e) 
za v o D S o z 
T 3s oI SA Ae, 7O ea [at 
no T Z ty 8 on So on 3 
aes v oS gg ss Eo So 
sag g 35 $2 85 Ge Be 
93 6 g S g og on oor 
foe 6 ge gs Z5 fa HA 
91 1376 58.54 12.11 %23.03 1305 800 DMU1 
57 1896 30.80 11.96 %18.72 1906 692 DMU2 
8 1842 46.25 12.08 %18.5 1758 718 DMU3 
37 1315. 18.55 12.07 %5.30 1500 682 DMU4 
34 787 39.10 11.96 %17 745 643 DMU5 
10 510 69 13.66 %3 517 555 DMU6 


Before implementation, a linear two-level program as per Model (5) is formulated as follows: 


max (uyup + U2121p t U31Y31p) + (U12Y12p + U22Y22p + Uz2V32p 
+ U42Y42p) + (U13Y13p + U23Y23p) + (U14Y14p), 
s.t. (V11X11p + V21X21p) + (V12X12p) + (V13X13p + V23X23p) 


+ (V14X14p + V24X24p) = 1, 
(uy 14 + Udtoi, + U31Y31j) + (U12Y123j + U22Y22j + U32Y32j + U42V49)) 
+(U13Y13j + U23Y23j) + (U14Y14j)-(V11X11j + V21X21j) + (V12X12j) + (V13X13j + V23X23)), 
(V14X14j F V24X24j) <0 j =1...10, 
Uy, + Ug] + Ug] = Uy, 
U12 + U22 + U32 + U42 = U2, 
U13 + U23 = U3, 


(8) 


u14 = Ug, 
Vit Va = V1, 
V12 = Va, 


Via + V23 = V1, 
VyiatVo4q = V1, 
Vik = 0, Urt >0. 


The results of implementing the above model and execution of the single-level model are presented in 
Table 3. 


Table 3. Results with single- level and two-level models. 


Name of Unit DMU1 DMU2 DMU3 DMU4 DMU5 DMU6 
Efficiency (two-level model) 0.864 0.967 1 0.687 0.726 0.576 
Efficiency (single-level model) 0.9254 1 1 0.8612 0.7576 0.6574 


Looking at the above table, we see that in the two-level model, DMU3, and the single-level model, 
DMUs 2 & 3 are more efficient than other units. The most serious inefficiency is related to DMU6, and 
other DMUs have less inefficiency. With a closer look at the table, we understand that the efficiency 
gained in the two-level model is not more than the two-level model due to their constraints. 


6 | Conclusion 


As we mentioned before, identifying different models of performance assessment and the correct 
identification and application of these models in social organizations are among the critical points. 
Techniques such as DEA and BSC ate tools that, although they may not be presented as alternative 
techniques, can lead to positive results when used in combination. The systematic perspective of BSC 
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in four aspects, in fact, leads the organization on its route to a strategy and is a critical complement for 


Mh 4 DEA in assessing the organization to make appropriate decisions. 
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